Skip to content

feat: Use write api for automatic data uploads #2338

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
TrevorBergeron wants to merge 7 commits into
base: main
Choose a base branch
from
Open

feat: Use write api for automatic data uploads #2338

TrevorBergeron wants to merge 7 commits into from
+50 −8

Conversation

@TrevorBergeron
Copy link
Contributor

@TrevorBergeron TrevorBergeron commented Dec 17, 2025

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@product-auto-label product-auto-label bot added size: xs Pull request size is extra small. api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. labels Dec 17, 2025
@TrevorBergeron TrevorBergeron marked this pull request as ready for review December 19, 2025 20:39
@TrevorBergeron TrevorBergeron requested review from a team as code owners December 19, 2025 20:39
tswast
tswast reviewed Jan 2, 2026
View reviewed changes
bigframes/session/__init__.py
mem_usage = pandas_dataframe.memory_usage(deep=True).sum()
if write_engine == "default":
write_engine = (
"bigquery_load"
Copy link
Collaborator

@tswast tswast Jan 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm a bit worried about https://docs.cloud.google.com/bigquery/docs/sandbox users. Maybe we could provide a global option for the default so that such users can switch back to load jobs (accepting the limitations for data types).

Copy link
Contributor Author

@TrevorBergeron TrevorBergeron Jan 12, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added config option in new version

@product-auto-label product-auto-label bot added size: m Pull request size is medium. and removed size: xs Pull request size is extra small. labels Jan 12, 2026
@TrevorBergeron TrevorBergeron requested a review from tswast January 12, 2026 23:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tswast tswast Awaiting requested review from tswast

At least 1 approving review is required to merge this pull request.

Assignees

@tswast tswast

Labels

api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. size: m Pull request size is medium.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@TrevorBergeron @tswast